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Abstract —We develop a constrained bimatrix game framework 
that can be used to model many practical problems in many 
disciplines, including jamming in packetized wireless networks. 
In contrast to the widely used zero-sum framework, in bimatrix 
games it is no longer required that the sum of the players’ utilities 
to be zero or constant, thus, can be used to model a much 
larger class of jamming problems. Additionally, in contrast to 
the standard bimatrix games, in constrained bimatrix games the 
players’ strategies must satisfy some linear constraint/inequality, 
consequently, not all strategies are feasible and the existence 
of the Nash equilibrium (NE) is not guaranteed anymore. We 
provide the necessary and sufficient conditions under which 
the existence of the Nash equilibrium is guaranteed, and show 
that the equilibrium pairs and the Nash equilibrium solution of 
the constrained game corresponds to the global maximum of a 
quadratic program. Finally, we use our game theoretic frame¬ 
work to find the optimal transmission and jamming strategies 
for a typical wireless link under power limited jamming. 

Index Terms —Wireless communications, jamming, adaptation, 
game theory, constrained games. 


I. Introduction 

T he convenience of wireless mobile communication has 
revolutionized the way we access information services 
and interact with the physical world. Beyond enabling mobile 
devices to access information and data services ubiquitously, 
wireless technology is widely used in cyber-physical sys¬ 
tems such as air-traffic control, power plants synchronization, 
transportation systems, navigation systems and human body 
implantable devices. This pervasiveness has elevated wireless 
communication systems to the level of critical infrastructure. 
Nevertheless, security issues of wireless communications re¬ 
main a serious concern. 

Physical layer in wireless networks is a broadcast medium 
that is subjected to adversaries. Among the many security 
threats that the wireless networks are subject to, jamming at 
the physical layer is one of the most prominent and challenging 
threats. Physical layer jamming not only can lead to service 
interruption/degradation or denial of service, but it is often a 
prelude to other upper layer attacks such as spoofing, man in 
the middle and downgrade attacks lU, 111, ||3], Sj, Q. 
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Furthermore, many modern wireless networks such as sen¬ 
sor, ad-hoc and mesh networks often operate in a decentral¬ 
ized, self-configurable fashion. Network nodes are governed 
by a distributed protocol which allows the nodes to choose an 
action, i.e., make a decision, from a set of available actions 
based on their evaluation of the network conditions (possibly 
relying on the information provided by the other nodes). These 
decisions not only have impact on the performance of individ¬ 
ual nodes but may have impact on the overall performance of 
the entire network. Nodes may seek the greater good of the 
network that is, they seek actions that optimize the overall 
performance of the entire network, or they can act selfishly 
and compete with other nodes to optimize their individual 
performance. Additionally, nodes may act maliciously, i.e, 
seek actions that result in performance degradation of the 
individual nodes or the entire network. 

All these examples have many of the characteristics that 
would lead to a natural game theoretic formulation as these 
problems cannot be completely modeled by the traditional op¬ 
timization tools. Moreover, as software defined radios (SDRs) 
and Cognitive Radios (CRs) become more capable of im¬ 
plementing more sophisticated and complicated adaptation 
algorithms, the assumptions of game theoretic models become 
an even better match for future wireless networks. 

Game theory has been used to solve problems in numerous 
aspects of wired and wireless communication systems — 
from security at the physical and MAC layer (e.g., jamming 
and eavesdropping) to routing and intrusion detection systems 
(e.g., collaborative IBS’s) at upper layers of the protocol stack. 
HD and the references therein provide a structured and compre¬ 
hensive overview of the game-theoretic approach to security 
and privacy in computer and communications networks. In 171, 
the authors use a layered approach to survey applications of 
game theory in wireless networking and game models that are 
most suitable for each problem. 

Reference 11 presents a classification of applications of 
game theory in network security based on the game model 
that is used to approach the problem. The survey covers both 
cooperative and non-cooperative games (see Table I in 0). In 
what follows, we briefly review some of the applications of 
game theory in wireless communications. We limit our focus to 
the physical layer applications, for applications of game theory 
in other network layers we refer the reader to 0 and Q. 

1) Dynamic Spectrum Access (DSA): addresses the issue of 
how to allocate the limited available spectrum among multiple 
wireless devices. This problem has two important aspects, 
spectrum usage efficiency and fairness to wireless users and 
can be modeled as a cooperative or non-cooperative game. 
Cooperative models such as bargaining games and coalition 
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games are often used where cooperation between spectrum 
users can result in an equilibrium that is more efficient and 
fair a, cni. 

On the other hand, when collaboration between network 
nodes is not possible or permitted for instance, when sec¬ 
ondary users compete for channel or spectrum access in 
cognitive radio networks, non-cooperative frameworks (e.g. 
auction-based games) are used to model this problem CD. 
In cognitive radio networks, the wireless spectrum is shared 
between primary users (users that are licensed to operate in 
that spectrum band) and secondary users (unlicensed users) 
where the secondary users access the spectrum in an oppor¬ 
tunistic manner. In this scenario, the secondary users compete 
with each other to access the bandwidth offered by the primary 
users and therefore; spectrum sharing in better modeled under 
the non-cooperative framework CD, CD. 

2) Power control in CDMA networks: is another example 
that has been studied by game theoretic approaches ca, oa, 
CD. In CDMA power control problem, a player’s utility 
function is usually defined such that it increases with the 
signal to interference plus noise ratio (SINR) but decreases 
with transmission power ini. This assumption is well justified 
since an increase in the SINR results in lower error probability 
and hence would increase the quality of service. Assuming all 
network nodes operate at hxed transmission power, an increase 
in a node’s transmission power, results in higher SINR for that 
node. However, increasing transmission power results in lower 
SINR for other users. Because most wireless nodes are battery- 
operated, energy management is an important consideration 
and if a node’s power is too high, not only it reduces other 
nodes’ SINR but it also wastes valuable battery life. 

3) Power control in OFDMA networks: Game theory has 
also been used to study power control in Orthogonal Frequency 
Devision Multiple Access (OFDMA) networks. In OFDMA 
networks, the objective is to minimize the overall transmission 
power under rate and power constraints by allocating users’ 
rates and powers to the available sub-channels. 

This problem has been studied in the literature in non- 
cooperative m, csi and cooperative frameworks ll20l . In 
non-cooperative framework network nodes use local and self¬ 
ish power control strategies to maximize their individual per¬ 
formances while in the cooperative framework, network nodes 
use distributed and (possibly) selfless power control strategies 
to optimize the overall performance and fairness of the system. 
It has been shown that game theoretic power control strategies 
can achieve significant individual and/or overall performance 
improvements over traditional power control algorithms m. 

4) The jamming problem: among the many security threats 
that the wireless networks are subject to, jamming at the 
physical layer is one of the most prominent and challenging 
threats. Jamming at the physical layer is often modeled as a 
zero-sum game, a special class of non-cooperative games ED, 
ED, ED, ED, ES- in a zero-sum game, for all strategy 
profiles the sum of players’ payoffs is zero and as a result, if 
a player gains a payoff, that payoff must have been lost by 
other player(s). Jamming in wireless communication is one 
such case as the players, the communicating nodes and the 
jammer, have completely conflicting goals. 



Fig. 1. Classification of standard and constrained games. 

In zero-sum game framework, it is usually assumed that 
the players have perfect knowledge of the game and the 
actions that are available to the other players, and they use 
this knowledge to compute their respective optimal strategies. 
In such a case, the zero-sum framework fully captures the 
conflicting goals of the players. Moreover, the equilibrium 
solution of the zero-sum game guarantees a minimum payoff 
regardless of the other player’s strategy ll26l . 

However, in some jamming scenarios, having perfect knowl¬ 
edge of the system parameters (or available actions) may not 
be a feasible option or too costly for a player. In addition, 
players may have objectives that are not exactly the opposite of 
each other, for example, the transmitter may wish to minimize 
the average error probability while the jammer wishes to 
minimize the average throughput of the system (as opposed 
to maximizing the average error probability). 

In such scenarios, a more appropriate framework to model 
the communication system under jamming would be a bimatrix 
game instead of a zero-sum gam^ In bimatrix games it is no 
longer required that the sum of the players’ payoffs to be 
zero (or a constant value) As a result, players can have 
different objectives and the respective payoffs can be defined 
based on the players’ goals and their knowledge of the game 
(which in general may be imperfect). Such a formulation, 
encompasses a variety of situations from full competition to 
full cooperation. 

Additionally, in standard zero-sum and bimatrix games there 
are no additional restrictions on players’ mixed-strategies, i.e., 
players may choose any probability distribution over their 
respective action sets (pure-strategies). However, there exist 
scenarios where, due to practical reasons, not all mixed- 
strategies are permitted and/or feasible. 

Such scenarios demand for a more general framework to 
study them. In this paper, we study a constrained bimatrix 
game to overcome these limitations. In constrained games, the 
players’ mixed-strategies not only have to be a probability dis¬ 
tributions but they must satisfy some additional constraints too 
(Figure [T] shows the classification of standard and constrained 
games). We study the necessary and sufficient conditions under 
which the existence of the Nash equilibrium is guaranteed as 
well as a systematic approach to find the NE. 

The rest of the paper is organized as follows, in Section |I^ 
we will introduce the constrained bimatrix framework and 
provide the necessary and sufficient conditions under which 
the existence of a constrained NE solution is guaranteed. In 

' It can be shown that zero-sum games ate special cases of the more general 
bimatrix games. 
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Section m we show that the solution of the this constrained 
game corresponds to the global maximizers of a quadratic 
program. In Section IV we will use the framework that we 
developed to study a typical jamming problem. Finally, we 
conclude the paper in Section |V] 


II. Constrained Bimatrix Games 

We start by introducing the concept of the Nash equilibrium 
(NE) for standard bimatrix games. Then, we generalize the 
standard bimatrix framework by adding linear constraints on 
the players strategies and formulate the constraint bimatrix 
framework. We refer the reader to Ea and the references 
therein for an introduction to some of the most fundamental 
concepts of non-cooperative game theory. This tutorial is 
specifically written for wireless network engineers and uses 
intuitive examples that are focused on wireless networks. Il28ll 
provides a more comprehensive review of non-cooperative 
game theory and its applications in wireless communications 
and networking. Throughout the rest of the paper, we refer to 
player one (row player) as the transmitter and refer to player 
two (column player) as the jammer. Nevertheless, applications 
of our framework is not limited to jamming in wireless 
communications. 

Consider a bimatrix game where transmitter’s action set (for 
instance, transmission rates) is given by 

72. = {ri,r2, • • • ,rm} r* e K+, 1 < i < m (1) 

Without loss of generality assume 72 is a sorted set, i.e., 0 < 
Ti < ■ ■ ■ < Ti-i < Ti < ■ ■ ■ < Tra- Transmitter’s vector of 
possible actions (simply, action vector) is the column vector 
r defined as 


= [g r2 •• • r, (2) 

where ^ indicates matrix transposition. Similarly, we define 
the jammer’s action set and action vector as 



J = (il! 72, • • • ,jn} 

jk G K+, 1 < k <n 

(3) 

and 

f = [ji h ■ ■ 

‘ jk • ■ • jn]ixn 

(4) 

where 

WLOG we assume, 0 

< jl < ■ ■ ■ < jk-1 < 

jk < 


■ ■ ■ < jn- A standard bimatrix game (also known as two-player 
general sum game) is defined by a pair of m x n matrices A 
and B such that, if player one plays row i and player two plays 
column k, the elements at row i and column k of the matrices 
A and B (i.e., aik and bik) would be the payoffs received by 
players one and two, respectively. 

If we let the players randomize their actions (i.e., allow 
them to use mixed-strategie^, the expected payoffs of the 
game for the mixed strategy profile (x, y) are 

A(x, y) = x^A y for player I 

iJ(x,y) = x^B y for player II 

where x G X™ = {x G = l} and y G 

Y” — {y G K"| X]r=i 2/fc = 1} are mixed-strategy vectors 


of players one and two, respectively. Player one’s goal is to 
find an optimal strategy, x, that maximize his expected payoff 
(given by payoff matrix A) against player two’s strategy, y, 
i.e., player one wants to solve the following problem 

maximize A(x, y) for all y G Y" (6) 

while player two’s goal is to maximize his own payoff (given 
by payoff matrix 73) by solving the following problem 

maximize 73 (x,y) for all x G X"* (7) 

ygY'i 

The strategy profile (x*, y*) is said to be an equilibrium pair 
(or equivalently the Nash equilibrium, NE) if (x*, y*) satisfies 
(|^ and (|7]i simultaneously. That is, x* maximizes (|^ for y* 
and y* maximizes Q for x*, and therefore, no player benefits 
by unilaterally changing his strategy. 

Theorem 1. Every finite bimatrix game in its standard form 
has at least one equilibrium pair (Nash equilibrium) in mixed- 
strategies. 

Proof: See Theorem 1 in ll2^ . ■ 

Consider a bimatrix game for which, due to practical rea¬ 
sons, not all mixed-strategies are permitted and/or are feasible. 
Eor instance, assume maximizing the average throughput of 
a wireless link. Maximizing the average throughput requires 
using higher transmission rates; but to maintain an acceptable 
error rate at the receiver, higher rates must be transmitted 
at higher transmission power. Because of battery limitation 
(internal limitation) or the ECC regulations (external limi¬ 
tations), the transmitter must keep its average transmission 
power below a certain value. Consequently, the wireless user 
cannot use certain actions that are more preferable to him (such 
as transmitting at the highest rate all the time). He may only 
choose actions that result in an average transmission power 
less than or equal to a predetermined value. 

Assume the mixed-strategy pair x and y must be chosen 
from some hyperpolyhedron defined by linear inequalities. 


X G X = {x G X™ 

< rave} 

(8) 

y G Y 4 {y e Y" 

j’^y < jave} 

(9) 


we denote this constraint game by ^ = (A, 73, r, j, rave; Jave) 
where A, 73 G are the payoff matrices for player one 

and two, respectively, and weight vectors r and j are given 
by (|^ and Q, respectivel}0 It is easily verified that for 
rave > maxTi and jave > maxjfe the constrained game 
simplifies to the bimatrix game in its standard form; hence, 
the unconstrained game can be viewed as a special case of the 
constrained games (see Eigure [^. Therefore, in the following 
we assume that at least one of the following inequalities holds 

rave < maxri or jave < maxjfc (10) 

By introducing ([^ and and assuming that ( [T0| ) holds, 
we are eliminating some mixed-strategies that could have been 
otherwise selected. Therefore, the existence of the NE solution 


player is playing a mixed-strategy if he randomizes his actions over his 
action set according to a probability distribution. 


^This is different from the bimatrix game in its standard form where the 
payoff matrices A and B completely define the game. 
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TABLE I 

Necessary and Sufficient Conditions for a Pair (x*,y*) to Be the NE. 


Player I 


Player II 


l^x* -1 = 0 

(LI) 

o 

II 

1 

h 

H 

(II.l) 

r'^x* - rave < 0 

(1.2) 

j^y* - Jave < 0 

(II.2) 

-X* < 0 

(1.3) 

-y* < 0 

(II.3) 

Ay* - UTmxl - «lmxl < 0 

(1.4) 

X*^B - rJ„xl - /31nxl < 0 

(II.4) 

x*'^A y* - urave — 0 = 0 

(1.5) 

y* - rjave - /3 = 0 

(II.5) 

u (r^x* - rave) = 0 

(1.6) 

r (j^y* - iave) = 0 

(II.6) 

Ti > 0, o G M 

(1.7) 

u > 0, /3 G M 

(II.7) 


for this constrained bimatrix game is not trivial and must be 
established (see Appendix). 

Assuming that in the constrained bimatrix game Q = (A, B, 
r, j, rave, jave), the jammer is playing his optimal strategy y*. 
Transmitter’s optimal strategy, x*, against y* is the maximizer 
of the following problem 

( l^x —1 = 0 

maximize x^A y* s.t. < r^x — rave <0 (11) 

"" i -X < 0 

Similarly, jammer’s optimal strategy, y*, against x* is the 
maximizer of the following problem 

r l^y-l = 0 

maximize x*^B y s.t. < j^y - jave < 0 (12) 

I -y<o 

Individually, o and © are linear programs, but x* and 
y* are not known in advance or in general they may not even 
exist. Theorem]^ gives the necessary and sufficient conditions 
that any Nash equilibrium solution of Q must satisfy. That 
is, every NE solution of Q satisfies the conditions in Table |I] 
and every strategy pair (x,y) that satisfies the conditions in 
Table must be a NE. Additionally, in the Appendix, we 
prove the conditions under which existence of the NE for this 
constrained bimatrix game is guaranteed. 

Theorem 2. Let Q = {A,B, r,j, rave, jave) be a constrained 
bimatrix game defined by matrices A, B £ A strategy 

pair (x*,y*) is an equilibrium pair (NE), if and only if there 
exists scalers u,v>0 and a, /? G K such that the conditions 
in Table are satisfied. 


Proof: Consider the KKT conditions for the linear pro¬ 
gram ©. The optimal solution x* must satisfy the primal 
feasibility conditions given by 

( I'^x* -1 = 0 

r^x* - rave < 0 (13) 

[ -X* < 0 

which are identical to conditions (1.1) - (1.3) in Table [I] Erom 
the dual feasibility conditions we must have 

m 

v(x*^A y*) -^A,V(-ain 

i=l (14) 

- uV (r^x* - rave) 

-pV(l'^x*-l) =0 


such that 

A* > 0, M > 0, /i e K (15) 

where Ai, u and p, are the KKT multipliers corresponding 
to constraints in ( [TT] i. If we simplify ( |T^ and use vector 
representations for KKT multipliers we get 

Ay* + Amxi - wr - plmxi = 0 (16) 


(17) 


or, equivalently. 

Ay* — UT — plmxi <0 M > 0 and p gR 

which gives us condition (1.4) in Table [I] (where we have 
made a change of variable, p —> a, and have used the fact 
that Amxi > 0). Einally, from the complementary slackness 
conditions we must have 

A^x* = 0 

u (r^x* - rave) = 0 

the second condition in ( fTS] ) is identical to (1-6). By multiply¬ 
ing ( [T6l l by x*^ and using A^x* = 0 we have 

x*^A y* + x*^A — itx*^r — px*^l = 0 (19) 


( 18 ) 


which can be further simplified to 

x*^A y* — wrave — p = 0 It > 0 and p gR (20) 

which results in condition (1.5) in Table In the exact same 
way, we can derive KKT’s necessary conditions of optimality 
for the jammer to get the conditions (II. 1) - (II.7) in Table 
To prove that these conditions are also sufficient, we can use 
the fact that the objective functions in © and © are linear 
(affine), and as a result, the KKT conditions are necessary and 
sufficient for optimality; this concludes the proof. ■ 

Table |I] summarizes the necessary and sufficient conditions 
of optimality for the constrained bimatrix game. Eurthermore, 
the following lemma, gives the expected payoff of the players 
at the Nash equilibrium. 


Lemma 1. Consider the constrained bimatrix game Q = 
{A,B, r,j, rave, jave)- The expected payoffs of the game for 
the equilibrium pair (x*, y*) are 

A(x*,y*) = urave + a (21) 

B(x*,y*) =rjave+/3 (22) 

for the transmitter and jammer, respectively. 

Proof: Eollows from conditions (1.5) and (II.5) in Table 
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III. Connection to Quadratic Programing 

While Theorem gives the necessary and sufficient con¬ 
ditions for the strategy profile (x*,y*) to be a NE of Q, it 
does not provide a constructive way to find the NE solution(s) 
and the equilibrium pairs of the constrained bimatrix game. 
We have previously shown that for every constrained 
two-player zero-sum game there exists an equivalent linear 
program whose solution yields a NE for the game and every 
NE of the game is a solution of the corresponding linear 
program. 

In this section, we show that there exist a similar con¬ 
nection between the NE solutions and equilibrium pairs of 
the constrained bimatrix games and global maximum(s) of a 
quadratic prograr^ In the following theorem, we show that 
the global maximum of the quadratic program in ( |2^ subject 
to the constraints in ( |24l l satisfies all conditions of Theorem 
and therefore, the corresponding maximizer is a NE solution 
of Q. 

Theorem 3. Let Q = B, x, y, ravei Jave) be a constrained 
bimatrix game with B G The strategy pair (x*, y*) 

is a Nash equilibrium of Q if and only if there exist scalers 
u*,v* > 0 and a*, l3* G K such that (x*, y*, u*, u*, a*, /S*) 
is a global maximizer of the following quadratic program 


maximize (A + B) y — Wave — tijave — a — P (23) 

x,y,u,v,a,/3 


subject to: 

Ay - UVmxl - almxi < 0 
X^B - vjnxl - /31nxl < 0 

r'^X - Tave < 0 
< - Jave < 0 

l^X- 1 = 0 
l^y -1 = 0 

—X, —y < 0, —rt, —u < 0 and a, /3 € K 


{M 

(24 

(M 

(M 

(M 

(M 

(M 


1 ) 

2 ) 

3) 

4) 

5) 

6 ) 

7) 


(24) 


Proof: Eirst, notice that the constraints in ( |24| ) satisfy 
all the conditions of Table [I] except for (1.5), (1.6) and (II.5), 
(II.6). As a result, if we show that the global maximum of the 
quadratic program in ( |2^ satisfies these additional conditions, 
then, by Theorem it must be a NE solution of Q. If we 
premultiply (f^l) by x^ and use 1^3) to simplify the result 
we have 

x'^A y - ura.ve - a<0 (25) 


since x^ is a probability vector and u > 0. Similarly, we can 
obtain the following inequality from p4|2) and ([24|4): 


is a global maximum of ( |23| l. Next, we will consider the 
KKT necessary conditions for optimality for the optimization 
problem in ( |2^ . To find the necessary KKT conditions, we 
stack the variables in the following vector and we take the 
gradients in the same order. 

Z^=[xfxrn ylxn U V a P ][^+„+4)xl (28) 


Erom this point forward, we assume all variables are optimal 
and for convenience, we drop the * from the variables. Primal 
feasibility conditions are identical to the constraints in ( |24l l. 
The dual feasibility condition necessitate^ that, for the global 
maximizer of (|2^, z, the gradient of /(z) must be a linear 
combination of the gradients of the binding constraints in ( [24l i, 
i.e., we must have 


-{A + B)y' 
iA + B)^x 

m 

0^4 

1_____ 

n 

> o.ta 
_1 


Tave 

Jave 

-1 

-1 

-Ev 

2^1 

-Ti 

0 

-1 

0 

k^l 

u 

-jk 

0 

-1 

-bi 


-b. 


ai 


0-2 


-E' 




■ 0 ■ 


■ 0 ■ 


0 


0 


-1 


0 


0 

- 02 

-1 

— 

0 


0 


0 


0 



0 

0 
0 
0 

^0 

Omx 1 
Onx 1 
Olxl 
Olxl 

Olxl 

Olxl 


-E' 

fc=l 


(i) 

(ii) 

(iii) 

(iv) 

(V) 

(Vi) 


r 

0 

0 

0 

0 

0 

0 

Sfe 

0 

0 

0 

0 


(29) 


where we have taken the gradients of the constraints in the 
same order as in and Ai^. and denote the Tth row 
of A and the i’th basis vector, respectively. Additionally, the 
KKT multipliers must satisfy 


pi ^ 0 

b-k 1 jL 0 

bi, &2, CTi, 0-2 > 0 

Ol, 02 s K 


for i = 1,..., TO 
for k = 1,... ,n 


(30) 


By inspecting parts (v) and (vi) of the systems of vector 
equations in ( |29l l, we observe that for the KKT multipliers Ai 
and p-k we have 


x^B y - ujave - /3 < 0 (26) 

by combining inequalities ( |25| l and ( |26] l we observe that 
f{x,y,u,v,a,P) = x^(A-I-B) y - wrave - tijave - a -/3 < 0 
Thus, any set of variables (x*,y*,u*,v*, a*, P*) that satisfies 
f{xfyfu*,v\a*,P*)=0 (27) 


^ Ai = 1, Ai > 0 and ^ = 1, > 0 (31) 

i=l k^l 

Now, let 

Ai = Xi for i = 1,..., TO 

bk=yk for fc = 1,. .., n (32) 

Ol = a, 02 = P 


“^The connection between standard bimatrix games and quadratic programs 
was first shown in (30) 


^The KKT conditions are the necessary conditions (not sufficient) since the 
objective function in i|23) is non-convex. 
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and note that, because of the constraints on the KKT mul¬ 
tipliers Ai, fik, oi and 02 , we are allowed to make these 
assumptions. From parts (iii) and (iv) of ( |24| we obtain 

j'^y - jave + 0-2=0 0-2 > 0 

X^r - rave + 0 - 1=0 0-1 > 0 


Transmitted packets 






Jamming signals 




Received packets 


AWGN 

aEE 3^”"[S 

\ 

J 


Base-station 


Mobile user 


and finally, from parts (i) and (ii) we have 

- b2j^ - /31^ + = 0 62 , 6 * > 0 

H ^ 2 , _ 

Ay — bir — al + cj) = 0 bi,4>>Q 

By substituting the KKT multipliers with the variables given 
in (|3^ we may write the complementary slackness conditions 


for as follows 

x^A y — ux^r — 0 = 0 (35) 

x^S y - rj'^y - /3 = 0 (36) 

6ir^x = 6irave (37) 

^2j'^y = &2jave (38) 

and 

(fP' X = 6^y = aiu = <72^ = 0 (39) 


Now, if we multiply the first relation in ( [3^ by v and use 
( |39l l to simplify the result we have 

v(fy-u..)+v., = 0 

^ 'Og y - jave) = 0 

which is identical to condition (11.6) in Table [I] Similarly, from 
the second relation in ( [33| l, we can obtain 

■u(x^r-rave) = 0 (41) 

which gives us condition (1.6) in Table Finally, if we post- 
multiply p4| ) by y and use ( |39] l to simplify the result we have 

x'^B y - & 2 j'^y - ^i^y + d^y = 0 

^ x^B y - 62 j^y -13 = 0 (42) 

comparing ( |42l i with ( [36] l we notice that b 2 = v and by using 
( |T7 | i we obtain the desired result: 

x^B y - rjave - /3 = 0 (43) 

Similarly, we can show that bi = u and 

x^A y - urayye -0 = 0 (44) 

Conditions ( |43| ) and ( |44| ) are exactly conditions (II.5) and (1.5) 
in Table |I] and as a result, the maximizer of the quadratic 
program in ( |23| l, subject to constraints in ( |24l l, satisfies all the 
conditions of Theorem and, hence, is a Nash equilibrium 
of Q. The last step is to show that the set of variables 
(x, y, M, u, o, /3) is indeed a global maximizer of ( [2^ . Adding 
to ( |44l i gives us the desired result. 

x^ [A+ B) y - - I'Jave -a- 13 = 0 (45) 

The converse of theorem states that if (x*, y*) is a NE pair, 
then, (x*, y*, M*, u*, o*,/?*) is a global maximizer of (|2^. By 


Fig. 2. Packetized AWGN link under power limited jamming. 


using Lemma and the necessary and sufficient conditions in 
Table 1^ it can be easily verified that 

x*^ {A + B)y*- jave -a* -P*=0 (46) 

and hence the NE solution of the constrained bimatrix game 
Q = (A, B, r, j, Tave, jave) IS indeed a global maximum of the 
quadratic program defined in ([2^. This concludes the proof. 


IV. A Special Case: Packetized AWGN Link under 
Power Limited Jamming 

In this section we use the framework we developed in 
the previous sections to study a typical jamming problem 
and show that the constrained bimatrix game can be used to 
formulate this typical problem. 

Consider the wireless communication system shown in 
Ligure The communication link between a base-station 
(transmitter) and a mobile user (receiver) is a single-hop, 
packet-switched, AWGN channel with fixed and known noise 
variance, N, measured at the receiver’s side. Lurthermore, 
assume the communication link is being disrupted by an 
average power limited additive Gaussian jammer with flat 
power spectral density. The impact of the Gaussian jammer 
on the communication link is the reduction of the effective 
signal to noise ratio (SNR) at the receiver from Pt/N to 
Pt/{N + J), where J represents the jammer power (variance) 
and Pt is the transmitter power, both measured at the receiver 
side. 

We assume that the jammer uses a set of discrete jamming 
power levels denoted by J. The jammer may use any jamming 
power but must maintain an overall average power constraint, 
denoted by Jave- The jammer uses his available power levels 
according to a probability distribution (his strategy) and his 
goal is to cause the maximum damage to the communication 
link by destroying as many packets as possible while main¬ 
taining the average power constraint. 

The base-station has a rate adaptation block with n differ¬ 
ent but fixed rates. Transmission rates are bounded between 
minimum and maximum rates denoted by Bmin and Rraax, 
respectively. Without loss of generality, we assume the rates 
are sorted in a decreasing order. Hence, the base-station’s 
action set, denoted by TZ, becomes 

7Z = ^Rq = Bniax ^ ^ Ri P " ^ R^—l = Bniin} 

Assuming Bmax is feasible and packets are long enough that 
channel capacity theorem could be applied to each packet, it 


(nats/tran^ 
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follows from the capacity of the discrete-time AWGN channel 
that we must have 


Pt > Pmin = N - 1) (48) 

to make all transmission rates viable. Throughout the rest of 
this section, we assume that the base-station transmits data 
packets at a fixed and known power, Pt, where Pt > T’min- 
The base-station uses the available rates according to a prob¬ 
ability distribution (his strategy) and his goal is to find an 
optimal strategy to maximize the average throughput of the 
channel subject to jamming. 

Given that the channel noise variance is fixed and known, 
corresponding to each transmission rate Rj G TZ there exists 
a certain jammer power, Jj > 0, such that if the actual 
jamming power used by the jammer is less than Jj, then 
reliable communication is possible, i.e.. 



Fig. 3. Average throughout at the NE as a function of Jave 


Rj = o log 1 


Pt 


N + P 


Jj = 


Pt 


^2Rj — ^ 


- N j = 0, • • • , n - 1 


(49) matrix with zero elements above the main diagonal, i.e., 

Rq 0 • ■ ■ 0 ~ 


Assuming that TZ is publicly available (such as the typical 
rates of IEEE 802.11 standard) and Pt and N could be 
estimated, the jammer can use to construct his action 
set, specifically, consider the following action set 

= |<A), Ji, • ■ • I >4i| (50) 

where Jj for 0 < j < n is given by 

_ f 0 j = 0 

~ j + 6N= + {6-1)N j = 1,... ,n 

The jammer adds 6N with 5 > 0 to his non-zero jamming 
powers to make sure that Rj is greater than the channel 
capacity corresponding to Jj. Jammer’s mixed-strategy set, 
is then the set of all probability vectors that result in 
an average power less than or equal to Jave, i-e.. 


C = 


Ri ■ ■ ■ Ri 0 ■ ■■ 0 


Pn— 1 


Rn-1 0 


(53) 


nx (n+1) 


Let tCraxi and y(„+i)xi be the base-station’s and jammer’s 
mixed-strategies, respectively. Then the base-station’s problem 
becomes the following maximization problem 


maximize x^Cy for all y G (54) 

It can be proved ll25l that this problem has closed form 
solution and the average throughput at the Nash equilibrium 
as a function of Jave is given by 


r^(„* _ '^m+l Jave JJ J ^ T ^ T 

^ iV ) — T T ^TTL «^ave,m _ «^ave »>'ave,m+l 

'^m+1 ^ave,m 

(55) 

for 1 < m < n — 1 and Jave m is defined as 


y:;,:' = {y(„+l)xl e v^J < ^ave} (51) 

where y(„_|_i)xi «^(ra+i)xi jammer’s mixed-strategy 
and jamming power vectors, respectively, and Y”+^ is a 
standard (n -f l)-simplex. 

Since destroyed packets do not contribute to the aver¬ 
age throughput of the communication system, the payoff 
per transmitted packet, C{Ri,Jj'), for the pure-strategy pair 
[Rj,Jj) G TZ y. J K equal to the transmission rate of that 
packet if the packet is recovered, and zero if it is destroyed, 
i.e., 

■^.Onars/.ans. = | (52) 


Jave.m = Rm^ {Rj ^ “ Rj-l) Jj l<m<n (56) 
i=i 

Eigure shows the average throughput of the communication 
link at the NE as a function of jammer’s average power for a 
typical case. Eor this example, we use the range of rates from 
the IEEE 802.11 standard, i.e., we assume coded data rates of 
the base station are distributed between i?niin = 1 Mbps and 
Rmax = 54 Mbps and the channel bandwidth is 22 MHz. 

Since jammer’s goal is to maximize the number of destroyed 
packets, we define the jammer’s payoff per packet to be 1 if the 
packet is destroyed and 0 if the packet is recovered. Thus, the 
jammer’s utility function for the pure-strategy pair {Ri, Jj) 
becomes 


Therefore the payoff matrix corresponding to ( |52l i, where 
the base-station is the row player, will be an n x (n -f 1) 


J(i?i, Jj) 


0 j <i 
1 j>i 


{Rj, Jj) GTZxJ (57) 
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and the payoff matrix corresponding to ( |57l l becomes 

0 1 ••• r 


= 


0 1 ••• 1 

• •• 0 i 


(58) 


- nx(n+l) 


Comparison of the payoff matrices in ( |5^ and ( |58l l clearly 
shows base-station’s and jammer’s conflicting goals; while the 
base-station’s non-zero payoffs appear on or below the main 
diagonal of his payoff matrix (C), jammer’s non-zero payoffs 
are above the main diagonal of his respective payoff matrix 
(J^). But in contrast to the zero-sum games, the sum of the 
two matrices in ( [53| l and (|5^ is not zero. 

Since the jammer’s utility function is not the negative of 
the base-station’s utility function the jammer can play two 
different games to cause damage to the performance of the 
communication link. The jammer can simply ignore base- 
station’s utility function and maximize his average utility 
based on his own payoff matrix. This game is equivalent to a 
constrained zero-sum game with matrix J given in ( [58] l and 
average power constraint J^ve where the jammer is the row 
player (maximizer). 

It can be easily verified that any row in jammer’s payoff 
matrix (J) is dominated by the last row which corresponds 
to his maximum jamming power (J„). But because of the 
average jamming power constraint, Jave, the jammer cannot 
use J„ all the time. As a result the optimal strategy for 
the jammer is to use his maximum jamming power with 
probability p = Javs/Jn and not jam a packet with proba¬ 
bility (1 — p). Therefore, jammer’s expected payoff (average 
destroyed packets) as a function of his average power for the 
constrained zero-sum game becomes 


J. 


zero-sum 


("^ave) — j Jay 


0 ^ Tave ^ Jn 


(59) 


The optimal strategy for this zero-sum game (this strategy is 
called the jammer’s maxmin strategy) guarantees the payoff 
given in ( |59| ) regardless of the base-station’s strategy. 

An alternative approach for the jammer is to play the 
constrained bimatrix game Q = (C, J^, R, Ravet J, Jawe), 
where R is the base station rate vector. Since in this special 
case the base station does not have an average constraint 
on its strategies. Rave is an arbitrary number that satisfies 
Rave > maxi?i. With this assumption, the condition (1.2) in 
Table [I] becomes redundant and from condition (1.5) in Table [I] 
it follows that it = 0, hence, the quadratic program in ( |2^ 
simplifies to 



Fig. 4. Average destroyed packets at the NE as a function of Jave 


and the expected payoff of the jammer at the NE becomes 

4matrix(^ave) =t2Vave + /3* (62) 

where v* and j3* are the global maximizers of ( |60| ). 

It can be shown (see Theorem 0 that for certain values 
of Jave, the maximization problem in ( |60l l has a closed form 
solution. For these specific values, the expected payoff of the 
base station is equal to R^, m = 0 ,..., n — 1. 


Theorem 4. In the constrained bimatrix game Q = {C, 
n, J, '^ave) 


Jave = Rin ^{Ri ^ “ Ri-l)J^ far m = 0, . . . , Ti - 1 (63) 

then, equilibrium pair solution, {x*,y*), and the optimal 
mixed-strategies are given by 


X 


*T 


y 


*T 


[xq, • ■ • 7 Xj, . . . Xm, 0] Xj — Jm ^Ji Ji—l) 

[ 2 / 0 ; ■ • ■ ; yi J • ■ ■ 0] Vi Rm {J^i ^i—1 ) 


(64) 


for the base station and the jammer respectively (where we 
used RZ.\ = J_i = 0). Furthermore, the expected payoffs of 
Q at the NE are 

X*^C y* = Rra 

y*^J X* = J-i ^{R-^ - i?-\) J. 

i=0 

Proof: It is sufficient to show that there exist u > 0 and 
a,(3 G M. for which ( |60l l is zero. Let v = Jjf^, a = Rm and 
/3 = 0, then 


maximize x^(^CJ'^)y — vJave — a — P 

x,y,v,a,j 3 

subject to 

Cy-al<0 
a: — vJ — pi < 0 

J y JavQ — (^ 
l^y-l = 0 
l^x -1 = 0 
, X, y, v>Q 


(60) x*^^c + J^)y*-J-^Jav.-Rm = Q (66) 

■ 

Analytical study and numerical simulations verify that the 
expected payoff at the NE for the constrained bimatrix game 
strictly outperforms the zero-sum game if the average jamming 

(61) power is less than a jamming threshold, Jth- That is, the 
expected payoff of the bimatrix game satisfies 

•^bimatrix ("^ave) > "^zeio-sum ('^ave) for all 0 < Jave < JtH (67) 
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Fig. 5. Single-valued function (left) vs. set-valued function (right). 

and 

'Ajimatrix ("^ave) = '^zero-sum (Ave) for >Ave ^ •^TH (68) 

The jamming threshold, Jxh, is the minimum average jamming 
power required to force a transmitter to operate at his lowest 
rate in a single-hop packetized wireless linlj^ It can be proved 
(see ||25]| Theorem 4) that the minimum average jamming 
power that can force the transmitter to use his lowest rate 
is given by 

n—1 

Jth = i?n-l ^ {RJ^ - Rjli)Jj (69) 

Figure shows a comparison between the expected payoff 
of the zero-sum game and the constrained bimatrix game for 
a typical case. As expected, the average payoff of the bimatrix 
game at the NE strictly dominates the zero-sum game for 
•Jme < Jth and the expected payoffs converge for Jave > Jth. 
i.e., the bimatrix game simplifies to a zero-sum game. 

V. Conclusion 

We developed a constrained bimatrix game framework that 
can be used to model many practical jamming problems 
in packetized wireless networks. In contrast to the standard 
bimatrix games, in constrained bimatrix games the players’ 
strategies must satisfy some additional average conditions, 
consequently, not all strategies are feasible and the existence of 
the NE is not guaranteed anymore. We provided the necessary 
and sufficient conditions under which the existence of the 
Nash equilibrium (NE) is guaranteed and showed that the 
equilibrium pairs and the Nash equilibrium solution of this 
constrained game corresponds to the global maximum of a 
quadratic program. Einally, we studied a typical packetized 
wireless link under power limited jamming and showed that 
the game theoretic analysis of this typical problem yields 
rather surprising results. 

Appendix 

Existence of the Nash Equilibrium for 
THE Constrained Bimatrix Game 

In game theory, fixed-point theorems are commonly used 
to prove that a model has an equilibrium point. In particular, 

^Theoretical analysis suggests that for a single-hop packetized commu- 
nication link under power limited jamming, such a threshold always exists 
ED, (m Experimental studies confirm the existence of such a threshold on 
jammer’s average power oil 


Brouwer’s fixed point theorem is often used to prove the ex¬ 
istence of a solution for finite games (e.g., see ia), however, 
the approach used in 1291 (and similar approaches) cannot 
be extended to constrained game. As a consequence of the 
average constrains on mixed-strategies, arbitrary probabilities 
cannot be assigned to some pure-strategies and as a result, a 
more general approach is required. In our approach, we use the 
Kakutani’s fixed point theorem to prove that our constrained 
bimatrix model has at least one equilibrium point. We start 
this section by providing some definitions. 

Set-valued function (set-function or correspondence); De¬ 
noted by F : AT =1 y is mapping from X to non-empty 
subsets of Y, i.e., for dl\ x & X we have F(x) £ 2^ — 0. As 
opposed to a single-valued function (or simply, a function), a 
set-valued function can map its input to more than one output. 
Eigure shows a comparison of a single-valued function and 
a set-valued function. 

Convexed-valued function: Let F : Ai =4 E be a set-valued 
function then F is convex-valued if F{x) is a convex set for 
all X ex. 

Upper semi-continuous: F is upper semi-continuous if the 
following holds; for every sequence Xk in X that converges 
to some point x e X and for every sequence yk in Y that 
converges to y e Y, if yk e F{xk) for all fc £ N, then 
y G F{x). 

Fixed point of a set-valued function: Let F ■. Z ^ Z 
a set-valued function then a:* £ Z is a fixed point of F if 

X* £ F{x*). 

The following theorem, known as Kakutani’s fixed point 
theorem, provides the sufficient conditions for a set-valued 
function defined on a subset of Euclidean space to have a 
fixed point. 

Theorem 5 ( Kakutani Eixed Point Theorem). Let Z C K” be 
a nonempty compact and convex set and let F \ Z ^ Z be 
an upper semi-continuous and convex-valued correspondence. 
Then F has a fixed point. 

Proof: See 1^ . ■ 

Theorem 6. Let Q = (^A,B, r,j, rave. Jave) be a constrained 
bimatrix game, then Q has a Nash equilibrium solution if 
rave > minri and jave > minjfc. 

Proof: Let F be a set-valued function defined on (Xx Y), 

F ; (X X Y) (X X Y) (70) 

where X and Y are defined in ([^ and (|^, respectively. 
Obviously, X C K"* and Y C K" are non-empty, closed 
and convex subsets. (Note that X and Y are intersections of 
standard fc-simplices and closed half spaces, furthermore, the 
intersections are non-empty since by assumption r^ve > min 
and jave > minjfc). Therefore, the subspace resulted by the 
Cartesian product of X and Y, (X x Y), is also a non-empty, 
closed and convex subset of Now define F, such that, 

^(x,y) = Fa.(y)xFj^(x) = {(x,y)} (x,y)£XxY (71) 
where 

Fx{y) = {xi} = argmax A y (72) 

xGX 
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and 

Fyi^) = {yU - argmax y (73) 

yeY 

That is, F maps every strategy pair (x, y) G X x Y to the 
Cartesian product of the sets {xi} and {yj} (given by Fa;(y) 
and Fy{x), respectively) where all x^’s are optimal against y 
and all y^’s are optimal against x. 

From ( [7^ and ([^it is clear that for all (x, y) G X x Y 
the set valued function Fx{y) depends only on y and Fy{x) 
depends only on x. Therefore, if we show that {x^} = F'£c(y) 
is convexed and upper semi-continuous for every y G Y by 
extending the exact same argument to {y^j = we 

can show that F{x,y) is convexed-valued and upper semi- 
continuous. 

Consider Fx{y) in ( |72l l, for any given y G Y the problem in 
is a linear program in x. Therefore, the solution is always 
at the intersection of some binding constraints, i.e., it is a 
polytope at some comer of the feasible region in the direction 
of the gradient of F^ (see Figure]^. As a result, the set {x^} is 
either a singleton in X (when VFa;(y) is not normal to some 
face of X - Figure]^ t(^) or a face of X (when Vi7c(y) is 
normal to some face of X - Figure bottom), in either case, 
the solution set is convex and compact for all y G Y. By 
using the same argument, it is clear that {yj} is also convex 
and compact for all x G X. Therefore, the set-valued function 
F(x, y) is also convexed-valued. 

It can be shown (by contradiction) that for every sequence 
yk in Y that converges to y and for every sequence x^ that 
converges to x such that x^ G F^{yk) for all A: G N then we 
must have x G F^iy). If F^ was not upper semi-continuous 
then X ^ Fx{y) for some sequence. Assume ^^(y) is a 
singleton in X (Figure]^ top), we can find K sufficiently large 
to make yK arbitrarily close to y and therefore, for all fc > AT 
we have Fx{yk>K) = Fx{y) = x which is a contradiction. 
This argument can be easily extended to the case where F^ (y) 
is some face of X (Figure bottom). 

Therefore, F^{y) is upper semi-continuous in X (so is 
Fy{x) in Y). Hence, F is an upper semi-continuous function 
Therefore, the set-valued function F(x, y) defined in ( [TT] ) 
satisfies the requirements of Kakutani’s theorem and has a 
fixed point (x*,y*) such that 

(x*,y*) G F(x*,y*) (74) 

that is, there exist a strategy pair (x*, y*) where its elements 
are optimal against each other and by definition, this is an 
equilibrium point of Q. This concludes the proof. ■ 
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